Fast Lean Erasure-Coded Atomic Memory Object

In this work, we propose FLECKS, an algorithm which implements atomic memory objects in a multi-writer multi-reader (MWMR) setting in asynchronous networks and server failures. FLECKS substantially reduces storage and communication costs over its replication-based counterparts by employing erasure-codes. FLECKS outperforms the previously proposed algorithms in terms of the metrics that to deliver good performance such as storage cost per object, communication cost a high fault-tolerance of clients and servers, guaranteed liveness of operation, and a given number of communication rounds per operation, etc. We provide proofs for liveness and atomicity properties of FLECKS and derive worst-case latency bounds for the operations. We implemented and deployed FLECKS in cloud-based clusters and demonstrate that FLECKS has substantially lower storage and bandwidth costs, and significantly lower latency of operations than the replication-based mechanisms

Highly Scalable Algorithms for Robust String Barcoding

String barcoding is a recently introduced technique for genomic-based identification of microorganisms. In this paper we describe the engineering of highly scalable algorithms for robust string barcoding. Our methods enable distinguisher selection based on whole genomic sequences of hundreds of microorganisms of up to bacterial size on a well-equipped workstation, and can be easily parallelized to further extend the applicability range to thousands of bacterial size genomes. Experimental results on both randomly generated and NCBI genomic data show that whole-genome based selection results in a number of distinguishers nearly matching the information theoretic lower bounds for the problem

RADON: Repairable Atomic Data Object in Networks

Erasure codes offer an efficient way to decrease storage and communication costs while implementing atomic memory service in asynchronous distributed storage systems. In this paper, we provide erasure-code-based algorithms having the additional ability to perform background repair of crashed nodes. A repair operation of a node in the crashed state is triggered externally, and is carried out by the concerned node via message exchanges with other active nodes in the system. Upon completion of repair, the node re-enters active state, and resumes participation in ongoing and future read, write, and repair operations. To guarantee liveness and atomicity simultaneously, existing works assume either the presence of nodes with stable storage, or presence of nodes that never crash during the execution. We demand neither of these; instead we consider a natural, yet practical network stability condition N1 that only restricts the number of nodes in the crashed/repair state during broadcast of any message. We present an erasure-code based algorithm RADON_{C} that is always live, and guarantees atomicity as long as condition N1 holds. In situations when the number of concurrent writes is limited, RADON_{C} has significantly improved storage and communication cost over a replication-based algorithm RADON_{R}, which also works under N1. We further show how a slightly stronger network stability condition N2 can be used to construct algorithms that never violate atomicity. The guarantee of atomicity comes at the expense of having an additional phase during the read and write operations

ARES: Adaptive, Reconfigurable, Erasure coded, atomic Storage

Atomicity or strong consistency is one of the fundamental, most intuitive, and hardest to provide primitives in distributed shared memory emulations. To ensure survivability, scalability, and availability of a storage service in the presence of failures, traditional approaches for atomic memory emulation, in message passing environments, replicate the objects across multiple servers. Compared to replication based algorithms, erasure code-based atomic memory algorithms has much lower storage and communication costs, but usually, they are harder to design. The difficulty of designing atomic memory algorithms further grows, when the set of servers may be changed to ensure survivability of the service over software and hardware upgrades, while avoiding service interruptions. Atomic memory algorithms for performing server reconfiguration, in the replicated systems, are very few, complex, and are still part of an active area of research; reconfigurations of erasure-code based algorithms are non-existent. In this work, we present ARES, an algorithmic framework that allows reconfiguration of the underlying servers, and is particularly suitable for erasure-code based algorithms emulating atomic objects. ARES introduces new configurations while keeping the service available. To use with ARES we also propose a new, and to our knowledge, the first two-round erasure code based algorithm TREAS, for emulating multi-writer, multi-reader (MWMR) atomic objects in asynchronous, message-passing environments, with near-optimal communication and storage costs. Our algorithms can tolerate crash failures of any client and some fraction of servers, and yet, guarantee safety and liveness property. Moreover, by bringing together the advantages of ARES and TREAS, we propose an optimized algorithm where new configurations can be installed without the objects values passing through the reconfiguration clients

Pathway-centric analysis of microbial metabolic potential and expression along nutrient and energy gradients in the western Atlantic Ocean

© The Author(s), 2022. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Cavaco, M. A., Bhatia, M. P., Hawley, A. K., Torres-Beltran, M., Johnson, W. M., Longnecker, K., Konwar, K., Kujawinski, E. B., & Hallam, S. J. Pathway-centric analysis of microbial metabolic potential and expression along nutrient and energy gradients in the western Atlantic Ocean. Frontiers in Marine Science, 9, (2022): 867310, https://doi.org/10.3389/fmars.2022.867310.Microbial communities play integral roles in driving nutrient and energy transformations in the ocean, collectively contributing to fundamental biogeochemical cycles. Although it is well known that these communities are stratified within the water column, there remains limited knowledge of how metabolic pathways are distributed and expressed. Here, we investigate pathway distribution and expression patterns from surface (5 m) to deep dark ocean (4000 m) at three stations along a 2765 km transect in the western South Atlantic Ocean. This study is based on new data, consisting of 43 samples for 16S rRNA gene sequencing, 20 samples for metagenomics and 19 samples for metatranscriptomics. Consistent with previous observations, we observed vertical zonation of microbial community structure largely partitioned between light and dark ocean waters. The metabolic pathways inferred from genomic sequence information and gene expression stratified with depth. For example, expression of photosynthetic pathways increased in sunlit waters. Conversely, expression of pathways related to carbon conversion processes, particularly those involving recalcitrant and organic carbon degradation pathways (i.e., oxidation of formaldehyde) increased in dark ocean waters. We also observed correlations between indicator taxa for specific depths with the selective expression of metabolic pathways. For example, SAR202, prevalent in deep waters, was strongly correlated with expression of the methanol oxidation pathway. From a biogeographic perspective, microbial communities along the transect encoded similar metabolic potential with some latitudinal stratification in gene expression. For example, at a station influenced by input from the Amazon River, expression of pathways related to oxidative stress was increased. Finally, when pairing distinct correlations between specific particulate metabolites (e.g., DMSP, AMP and MTA) and both the taxonomic microbial community and metatranscriptomic pathways across depth and space, we were able to observe how changes in the marine metabolite pool may be influenced by microbial function and vice versa. Taken together, these results indicate that marine microbial communities encode a core repertoire of widely distributed metabolic pathways that are differentially regulated along nutrient and energy gradients. Such pathway distribution patterns are consistent with robustness in microbial food webs and indicate a high degree of functional redundancy.This work was funded by the NSF Division of Ocean Sciences (Grant no. OCE-1154320 to EK and KL) and a small (“Microbial controls on marine organic carbon cycling”) and large (“Marine microbial communities from the Southern Atlantic Ocean transect to study dissolved organic matter and carbon cycling”) community sequencing grants from the Joint Genome Institute (US Department of Energy, Walnut Creek, CA) to SH and MB. MB was supported by an NSERC post-doctoral fellowship and a CIFAR Global Scholars fellowship. MC was supported by a Campus Alberta Innovates Program (CAIP) chair to MB

A multimodal cell census and atlas of the mammalian primary motor cortex

ABSTRACT We report the generation of a multimodal cell census and atlas of the mammalian primary motor cortex (MOp or M1) as the initial product of the BRAIN Initiative Cell Census Network (BICCN). This was achieved by coordinated large-scale analyses of single-cell transcriptomes, chromatin accessibility, DNA methylomes, spatially resolved single-cell transcriptomes, morphological and electrophysiological properties, and cellular resolution input-output mapping, integrated through cross-modal computational analysis. Together, our results advance the collective knowledge and understanding of brain cell type organization: First, our study reveals a unified molecular genetic landscape of cortical cell types that congruently integrates their transcriptome, open chromatin and DNA methylation maps. Second, cross-species analysis achieves a unified taxonomy of transcriptomic types and their hierarchical organization that are conserved from mouse to marmoset and human. Third, cross-modal analysis provides compelling evidence for the epigenomic, transcriptomic, and gene regulatory basis of neuronal phenotypes such as their physiological and anatomical properties, demonstrating the biological validity and genomic underpinning of neuron types and subtypes. Fourth, in situ single-cell transcriptomics provides a spatially-resolved cell type atlas of the motor cortex. Fifth, integrated transcriptomic, epigenomic and anatomical analyses reveal the correspondence between neural circuits and transcriptomic cell types. We further present an extensive genetic toolset for targeting and fate mapping glutamatergic projection neuron types toward linking their developmental trajectory to their circuit function. Together, our results establish a unified and mechanistic framework of neuronal cell type organization that integrates multi-layered molecular genetic and spatial information with multi-faceted phenotypic properties